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ABSTRACT 


We  consider  nonlinear  constrained  optimization  problems  whose  objective 
and  constraint  functions  are  sufficiently  smooth.  No  convexity  is  assumed. 

Our  basic  tools  are  from  differential  topology.  We  show  that  these 
problems  can  be  reduced  to  the  study  of  minimizing  a  Morse  function  on  a 
manifold  with  boundary  and  we  give  the  geometrical  meaning  to  the  first  order 
conditions,  the  second  order  sufficiency  conditions,  and  strict  complementary 
slackness  condition. 

Our  main  concerns  are  the  second  order  sufficiency  conditions, 
sensitivity  analysis,  generic  properties  of  smooth  nonlinear  programs,  global 
duality,  local  uniquenss,  and  strict  complementary  slackness. 
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SIGNIFICANCE  AND  EXPLANATION 


Nonlinear  optimization  problems  arise  in  economic  theory,  in  management 
science  and  in  other  fields.  In  the  analysis  of  global  optima  of  such 
problems,  we  quite  often  assume  the  functions  concerned  are  convex.  But  in 
general  those  functions  cannot  be  expected  to  be  convex. 

In  this  paper  it  is  assumed  that  those  functions  are  not  necessarily 
convex  but  sufficiently  smooth.  We  show  that  almost  always  nonlinear 
optimization  problems  have  a  unique  global  solution  if  global  solutions  exist, 
and  we  also  show  that  with  slightly  perturbed  data  of  a  special  type,  those 
global  optima  almost  always  change  smoothly  in  a  certain  problem. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


MORSE  PROGRAMS:  A  TOPOLOGICAL  APPROACH  TO 
SMOOTH  CONSTRAINED  OPTIMIZATION 

Okitsugu  Fujiwara 

1 .  Introduction 

The  nonlinear  programming  problem 
(Q ) :  minimize{ f ( x)  subject  to  g(x)  <  b} 

where  x  e  Rn,  b  e  Rm  is  called  a  convex  program  if  f  and  g  are  convex. 

Convex  programs  enjoy  a  number  of  desirable  global  properties  (e.g. 

Mangasarian  [12],  Rockafellar  [13])  which  do  not  hold  in  nonconvex  programs. 

But  these  properties  are  true  locally  under  certain  constraint  qualifications 

(e.g.  Fiacco  and  McCormick  [6],  Avriel  [2]).  An  important  question  is:  do 

these  constraint  qualifications  hold  for  almost  all  nonlinear  programs?  This 

question  was  recently  answered  affirmatively  by  Spingarn  and  Rockafellar  [17] 

who  showed,  assuming  differentiability  of  the  objective  and  constraint 

functions,  at  any  local  minimum  point  x*  of  (Q(u,v)),  where 

T 

(Q(u,v)):  minimize{  f  ( x)  -  u  x  subject  to  g(x)  4  b  +  v}  , 

★ 

that  the  Jacobian  matrix  of  g  at  x  has  full  rank;  the  strict 

complementary  slackness  condition;  and  the  second  order  sufficiency  conditions 

*  n  m 

hold  at  x  ,  for  almost  every  (u,v)  in  R  x  r  . 

However  their  clever  argument  is  analytic  and  devoid  of  geometrical 

intuition.  Spingarn  ([14],  [15],  [16])  has  provided  a  geometrical 

interpretation  of  his  results  using  his  notion  "cyrtohedra" ,  a  generalization 

of  manifolds  with  corners. 

Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C-004 1 .  This 
is  the  revised  version  of  Cowles  Foundation  Discussion  Paper  No.  539  (Yale 
University)  supported  in  part  by  National  Science  Foundation  Grants  ENG-78- 
25182  and  SOC-77-03277 . 


The  purpose  of  this  paper  is  also  to  give  a  geometrical  answer  to  the 
question:  do  the  strong  second  order  sufficiency  conditions  hold  at  any  local 
minimum  point  for  almost  all  nonlinear  programs?  Our  idea  is  to  reduce  the 
nonlinear  programming  problem  to  a  finite  family  of  "well-behaved"  nonlinear 
programs  by  perturbing  the  objective  function  in  a  linear  fashion  and 
perturbing  the  right  hand  side  of  the  constraints  by  adding  a  constant.  Each 
of  the  "well-behaved"  nonlinear  programs  will  consist  of  minimizing  a  Morse 
function  on  a  manifold  with  boundary,  where  the  Morse  function  has  no  critical 
points  on  the  boundary.  The  constraint  set  being  a  manifold  with  boundary  is 
the  geometrical  meaning  of  the  full  rank  condition  of  the  Jacobian;  the 
objective  function  being  a  Morse  function  is  the  geometrical  meaning  of  the 
second  order  sufficiency  conditions;  the  lack  of  critical  points  on  the 
boundary  is  the  geometrical  meaning  of  strict  complementary  slackness 
condition.  Moreover,  our  perturbation  gives  us  a  unique  global  solution. 

We  follow  a  classical  tradition  of  first  studying  an  equality  constrained 
program,  in  which  the  feasible  region  is  a  manifold  without  boundary;  and  then 
reducing  an  inequality  constrained  program  to  a  finite  family  of  constrained 
programs  whose  constraints  consist  of  a  finite  set  of  equalities  and  one 
inequality  (through  the  device  of  active  or  binding  constraints),  where  we 
decompose  the  feasible  region  into  a  finite  number  of  manifolds  with  boundary. 

Our  main  concerns  are  the  second  order  sufficiency  conditions  (Theorems 
A,  F) ;  sensitivity  analysis  (Theorems  B,  E);  generic  properties  of  smooth 
nonlinear  programs  (Theorems  C,  H) ;  strict  complementary  slackness  condition 
(Theorem  G),  and  local  uniqueness  (Theorem  E). 
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2 .  Basic  Definitions  and  Notation 

A  property  that  holds  except  on  a  subset  of  Rn  whose  Lebesgue  measure 
is  zero  is  said  to  hold  at  almost  every  u  £.  Rn.  The  complement  of  a  measure 
zero  set  in  Rn  is  said  to  have  full  measure  in  Rn. 

The  Jacobian  matrix  and  the  Hessian  matrix  of  f  at  x  are  denoted  by 

2 

Df(x)  and  D  f ( x)  respectively. 

Let  f  :  M  Rm  be  a  CY  map  from  a  k-dimensional  C1  manifold  M 

with  boundary  3m  in  Rn.  Let  ($,U)  be  a  local  parametrization  of  M 

k  k 

at  x  such  that  x  =  $(u)  #  u  e  U  £  H  =  {xe  R  |x^  >  0}.  The  tangent  space 
TxM  of  M  at  x  is  defined  to  be  the  image  of  D<f>(u)  :  R^  Rn.  A  point 
x  e  M  is  a  regular  point  of  f  if  D(f$>)(u)  :  Rk  R1"  is  surjective, 

otherwise  x  is  a  critical  point  of  f.  A  critical  point  x  of 

1  2 
f  s  M  R  is  nondegenerate  if  the  k  x  k  matrix  D  (f<J>)(u)  is 

nonsingular.  It  is  easily  shewn  that  the  above  definitions  do  not  depend  on 

the  choice  of  local  parametrization.  A  point  y  E  Rm  is  a  regular  value  of 

r,  denoted  by  f  A  y.,  if  every  x  e  f  1 C y )  is  a  regular  point  of  f, 

otherwise  y  is  a  critical  value  of  f .  f  :  M  +  R^  is  a  Morse  function  if 

all  critical  points  of  f  are  nondegenerate. 

Let  f  :  M  ♦  N  be  a  map,  A  £  N  be  a  submanifold  of  N.  f 

is  transversal  to  A,  denoted  by  f  A  A,  if  for  every  x  e  f  ^ ( A) , 

Image  Df(x)  +  Tf(x)A  =  Tf(x^N  holds,  where  Df(x)  :  TxM  -*■  Tf(xjN  is  the 

derivative  of  f.  Two  submanifolds  A,  B  of  M  are  transversal  denoted  by 

A  A  B,  if  i  A  B  where  i  :  A  -*■  M  is  the  inclusion  map.  f  is  an  immersion 

if  for  every  x  e  M,  Df(x)  :  T  M  +  T_.  .N  is  injective,  f  is  a  submersion 

x  f(x)  J  - 

if  Df(x)  is  surjective  for  every  x  e  M.  f  is  proper  if  the  preimage  of 

every  compact  set  in  N  is  '-ompact  in  M.  An  immersion  that  is  injective  and 

proper  is  called  an  embedding. 
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We  refer  the  interested  reader  to  Guillemin  and  Pollack  [8]  for  an 
introduction  to  the  concepts  of  differential  topology  that  will  be  used  in 
this  paper.  Those  theorems  of  elementary  differential  topology  which  are  used 
in  the  body  of  this  paper  are  stated  in  the  appendix.  The  proofs  of  those 
theorems  can  be  found  in  Gillemin/Pollack  [8]  and  Hirsch  [10] . 


3 .  Equality  Constraints;  Properties  of  Morse  Programs 


Throughout  this  section  we  consider  a  program 
(P):  minimize  {f(x)  subject  to  g(x)  =  b} 

and  a  perturbation  of  (P) 

T 

(P(u,v)):  minimize  {f(x)  -  u  x  subject  to  g{x)  =  b  +  v} 

.  ,  n  1  n  m  n  _m  .  ,  _ 

where  f:R  -*•  R  ,  g  :  R  -*■  R  ;  u  e  R  ,  v  e  R  ;  n  >  m,  and  we  assume  f 

2 

and  g  are  of  class  C  . 

Definition.  A  program  (P)  is  a  Morse  program  if  g  ^  b  and  f  is  a  Morse 
function  on  g-1(b). 

Definition.  A  point  x  e  g  *(b)  is  a  critical  point  of  (P)  if  x  is  a 
critical  point  of  f  on  g-1(b). 

It  is  easily  verified  that  nondegenerate  critical  points  are  isolated 
(cf.  Guillemin/Pollack  [8]).  Hence  each  critical  point  of  a  Morse  program 
(P)  is  isolated.  By  the  Morse  Lemma  (Appendix  (1))  the  local  behavior  of  a 
function  at  a  nondegenerate  critical  point  is  completely  determined,  i.e.,  at 
any  critical  point  of  a  Morse  program  (P),  f  has  a  strict  local  minimum,  a 

strict  local  maximum,  or  a  saddle  point. 

7—1  7 

If  g  A  b  and  g  £  C  then  g  (b)  is  ( n-m)-dimensional  C 

submanifold  of  Rn  (Appendix  (5)). 

A  Morse  program  has  three  distinguishing  properties: 

(a)  The  second  order  sufficiency  conditions  hold  at  every  local 
minimum  point  of  a  Morse  program  (P)  (Theorem  A). 

(b)  If  x  is  a  critical  point  of  a  Morse  program  (P),  then  the 
associated  Lagrange  multiplier  A  exists  and 


the  matrix 


is  non- 


D2f(x)  +  £  X.D2g  (x)  Dg(x)T 

i=1  1  1 

Dg(x)  0 

singular  (Theorem  B) . 

( c)  Generically  (P)  can  be  considered  a  Morse  program,  namely 

(P(u,v))  is  a  Morse  program  for  almost  every  (u,v)  e  Rn  *  Rm 
(Theorem  C ) . 

We  will  discuss  the  existence  of  the  Lagrange  multiplier  and  its 

uniqueness  geometrically,  without  using  Farkas  lemma. 

y  —  1 

Suppose  g  A  b  and  g  e  C  (y  >  2).  Then  M  =  g  (b)  is  (n-m)- 

dimensional  submanifold  of  Rn  and  at  each  point  x  e  M  Dg(x)  has  full 

rank,  hence  Rn  =  Ker  Dg(x)  ©  Im  Dg(x)T  and  T^  =  Ker  Dg(x)  (because 

differentiating  g<f>  5  b  on  U,  where  (<j>,U)  is  a  local  parametrization  of 

M  at  x  -  we  obtain  TJ<  =  Im  0#(p)  c  Ker  Dg(x ).  Comparing  dimensions 

of  both  sides  we  have  T^M  =  Ker  Og(x)).  A  point  x  e  M  is  a  critical  point 
of  f  on  M  iff  Df(x)T  J_  TXM,  because  D(f<)))(p)Rn  m  =  Df (x)D4>(p)Rn  m 
=  Df(x)TxM  =  {0}  iff  Df(x)T  JL  TxM.  Then  Df(x)T  e  Im  Dg(x)T. 

Hence  we  have 

Lemma! . 1  ^  _If_  g  A  b,  then  x  e  g  \b)  has  a  Lagrange  multiplier  iff  x  is 
a  critical  point  of  f  jon  g~^(b).  Moreover  the  Lagrange  multiplier  is 
uniquely  determined. 

The  next  lemma  gives  a  representation  of  the  Hessian  matrix  of  f  at 
x  e  g  ^ ( b) ,  in  terms  of  the  seond  derivative  of  the  Lagrangian  at  x. 


1) 

This  fact  has  been  pointed  out  previously  by  Tanabe  ([18]  Proposition  1). 
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if 


Lemma  2. 


-1 


1 ) 


Let  g  iH  b,  x  be  a  critical  point  of  M  =  g  vjj;  wxua  me 


2  r  2 

associated  Lagrange  multiplier  X,  L(x)  =  D  f(x)  +  i  X.D  g.(x)  and  ( <J> ,  U ) 

i=1  i  1 


be  a  local  parametrization  of  M  _at  x  such  that  x  =  cf>  ( p )  for 
p  e  U  _c  Rn-m.  Then  D2(f4>)(u)  =  D<{>(  p)T  L(  x)D$  (  p)  . 

Proof.  '  By  the  chain  rule  we  have 


(3.1)  D2  (  f  4> )  ( p)  =  D$(p)TD2f(x)D(j>(p)  +  I  -  D2<|i  .  (p) 

3=1  *3  3 


m  m 

Differentiating  £  \.(g.<p)  =  £  X.b,  on  U,  we  have 

i=1  i=1 


(3.2) 


D<Mp)T(  I  X  D2g  ( x)  )d<{>  (p)  +  l 
i=1  j=1 


l 

i=1 


9g^  ( x) 

~3 T 
3  ■ 


D  4.  .  (p)  =  0 
3 


Adding  (3.2)  to  (3.1)  and  talcing  account  Df(x)  +  £  X^Dg^fx)  =  0,  we 
obtain  D2(f<|>)(p)  =  D4> (p)TL(x)D4>(p)  . 

Q  •  E  •  D  • 

For  s  e  T^M,  L(x)s  is  in  Rn  but  not  necessarily  in  T^.  To  obtain  a 
linear  homomorphism  on  TXM,  we  project  L(x)s  orthogonally  onto  TXM.  We 
denote  this  linear  homomorphism  on  TXM  by  LM(x),  which  we  call  the  induced 
homomorphism  of  (_(*)  2H.  TXM  (Luenberger  [11],  10.4).  Let  ($,U)  be  a 

local  parametrization  of  M  at  x  such  that  x  =  $(p),  p  e  U  £  R  .  We  can 
choose  ( $  ,U)  so  that  the  column  vectors  of  Dcf>  ( p )  are  orthonormal  in  Rn. 
Then  it  is  easily  shown  that  the  matrix  representation  of  /-M(x)  with  respect 


1) 

This  fact  has  been  pointed  out  previously  by  Tanabe  ([19]  Lemma  5.4). 

2) 

The  idea  for  this  proof  was  first  given  by  Luenberger  [11],  10.3. 
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“’i-1 


to  the  column  vectors  of  D<j>(p),  which  is  an  orthonormal  basis  of  TxM ,  is 
T 

D4> ( P )  L(x)D<f>(p)  (Luenberger  [11],  10.4).  Hence  by  Lemma  2  we  obtain 

Lemma  3 .  Let  g  b  and  let  x  be  a  critcal  point  of  f  _on  M  =  g~ 1  ( b)  . 
Then 

x  is  nondegenerate  iff  LM(x)  is  an  isomorphiam 

Note  that  if  x  is  nondegenerate,  then  L(x)lT  M  is  1-1  since 

L  (x)D<j>(p)  is  1  -  1,  and  we  have 

(3.3)  L(x)TxM  n  Ker  D<j>(p)T  =  {0}  . 

If,  on  the  other  hand,  L(x) T^M  n  Ker  D4>(p)T  4=  fo},  then 

T 

dimlKxJT^M  n  Ker  D$(p)  }  >  1.  Hence  we  have 

dim  Im{D<j)( p)T  [(  x)Di{i ( p)  }  =  dim  D<J>(p)T  U  x)T^M 

=  dim  l(x)T  M  -  dim{[(x)T  M  n  Ker  D£(p)T} 

X  X 

<  n  -  m 


which  contradicts  the  nondegeneracy  of  x. 

Lemma  3  shows  that  a  Morse  function,  whose  critical  points  are  all 
nondegenerate,  is  an  appropriate  concept  for  the  analysis  of  the  second  order 
optimality  conditions.  Summarizing  the  above  argument,  we  obtain  the  first 


property  of  a 

Morse 

program. 

Theorem  A.  Let  (P) 

be  a  Morse  program 

and 

x  be  a  critical  point  of 

(P).  Then  we 

have 

(a) 

Dg(x) 

has  full  rank 

(b) 

there 

exists  a  unique  A  e 

Rm 

such  that 

Df  (  x)T  +  Dg(  x)T; 

(c) 

L  ( x)  = 

m  _ 

D2f ( x)  +  l  A.D  g. 

(x) 

induces  an 

isomorphism  on 

i=1  1  1 

where  M  =  a- ^ ( b) . 


(d)  on  TXM>  L(x)  is  positive  definite  iff  x  is  a  local  minimum, 
negative  definite  iff  x  is  a  local  maximum;  indefinite  iff 
x  is  a  saddle  point. 

Proof .  (a),  (b),  and  (c)  follow  from,  respectively,  g  1  b.  Lemma  1,  and 

Lemma  3.  (d):  positive  (negative)  definite  =*  local  minimum  (maximum)  is 

obvious.  If  x  is  a  local  minimum  (maximum),  then  L(x)  is  positive 
(negative)  semidefinite  on  T^M.  However,  since  sTUx)s  =  s*/_M(x)s  .or 
s  £  T  M,  by  Lemma  3  L(x)  must  be  positive  (negative)  definite  on  TxM. 

The  saddle  point  case  is  an  immediate  consequence  of  the  preceding  argument. 

Q.E.D. 

Now  let  us  vary  the  right  hand  side  b  e.  Rm  and  consider  a  critical 
point  x  of  (P)  as  a  function  of  b,  denoted  by  x(b).  A  sufficient 
condition  that  x(*)  is  a  C1  function  of  b  is  the  nonsingularity  of  the 
matrix 


(3.4) 


(this  follows  from  the  implicit  function  theorem). 

Consider  the  function  F.  :  R°  x  Rm  ->•  Rn  x  Rm  defined  by  F.  (x,X)  :  = 

f>  b 

T  T 

(Df(x)  +  Dg( x)  X,  g(x)  -  b) .  Then  the  nonsingularity  of  (3.4)  for  every 
critical  point  x  and  its  associated  Lagrange  multiplier  X,  is  equivalent 
to  F^  rfv  0,  which  is  equivalent  to  f  being  a  Morse  function  on  M  =  g  ^b) 
namely  we  have 

Theorem  B.  Let  g  A  b.  Then 

Fb  0  iff  f  is  a  Morse  function  on  M  =  g”^(b) 


-9- 


Proof . 

Let  (4>,U)  be  a  local  parametrization  of  M  at  x  such  that  x  *  $(p) 
for  p  e  (J  £  Rn  m. 

(If)  Let  (x,X)  e  F^CO),  then  x  is  a  critical  point  of  f  on  M  (Lemma 
1 )  and  x  is  nondegenerate  because  f  is  a  Morse  function  on  M.  Suppose 


L(x)  Dg(x) 


Dg(  x) 


l(x)s  +  Dg(x)  t 
Dg( x) s 


.  Then  s  £  Ker  Dg(x)  =  T^M 


T  T  ,r  T 

and  L(x)s  =  -Dg(x)  t  e  Im  Dg(x)  .  Note  that  Im  Dg(x)*  =  Ker  D$(p)  . 

T  J. 

Because  we  have  Im  Dg(x)  =  (Ker  Dg(x))  (orthogonal  complement  of  Ker  Dg(x) 
T  J_ 

in  R  ),  Ker  Dt}>  ( p )  =  ( Im  D<j>(p))  ,  and  Ker  Dg(x)  =  T^M  =  Im  D(j>(p).  Hence 

T 

l(x)s  e  L(x)  T^M  n  Ker  D<J> ( p )  '  so  by  (3.3)  i.(x) s  =  0.  Since  i-(x)  is 

T 

1-1  on  TxM,  this  implies  s  =  0.  Hence  t  =  0  since  Dg(x)  is  1-1. 

Therefore,  we  obtain  Ker  DF, (x,X)  =  {o}  for  any  (x,X)  £  F.^(0).  Hence 

b  b 

Ffa  *  0. 

(Only  if) 


Let  x  be  a  critical  point  of  f  on  M.  Then  there  exists  X  e  R 

T 

such  that  F,  (  x  ,X  )  =0  by  Lemma  1.  Suppose  D<j>(p)  I_(x)D<}>(p)r  =  0  for  some 

b 

r  e  Rn  m.  Let  s  =  D<|>(p)r,  then  L(x)s  £  Ker  D<J>(p)T  =  Im  Dg(x)T  hence 

rp  m 

i(x)s  =  Dg(x)  t  for  some  t  €  R  .  Then 


L(x)  Dg(  x) 


Dg(  x) 


L(x)s  -  Dg(x)  t 


Dg(x) s 


because  s  £  Im  D$(p)  = 


TXM  =  Ker  Dg(x).  Hence  s  =  0  and  r  =  0  because  DFfa(x,X)  is  nonsingular 

T 

and  D<p(p)  is  1-1.  Therefore  D$(p)  L(x)  D(J)  ( p)  is  1-1,  hence 


nonsingular,  and  by  Lemma  3  x  is  rondegenerate . 


Q .  E .  D. 


I 


The  third  property  of  Morse  programs  is  genericity.  In  general  (P)  is 


not  necessarily  a  Morse  program,  but  we  have. 

Theorem  C.1^  —  f  z  ^  and  g  c  c"  m+1 ,  then  for  almost  every  fixed 
v  e  Rm,  (p(u,v))  is  a  Morse  program  having  at  most  one  global  solution  for 
almost  every  u  e  Rn. 

Proof .  By  Sard's  Theorem  (Appendix  (2))  if  g  :  Rn  ♦  Rm  is  of  class  Cn_n,f1, 
then  g  A  b+v  for  almost  every  v  e  Rm.  For  a  C2  manifold  X  c_  Rn  and  a 
C2  map  h  :  X  R1,  h(x)  -  uTx  is  a  Morse  function  for  almost  every  u  e  Rn 
(Appendix  (6)).  Therefore  for  v  e  Rm  such  that  g  A  b+v,  f(x)  -  uTx  is  a 
Morse  function  on  g""^(bt-v)  for  almost  every  u  e  Rn.  By  Araujo  and  Mas- 

Colell  ([1],  Theorem  I),2 5  we  have 

Fix  any  v  e  Rm,  then  for  almost  every  u  e  Rn 
(P(u,v))  has  at  most  one  global  solution. 


Q  •  E. D. 


1  ) 

It  can  be  shown  that 

If  f  e  C2  and  g  e  cn-m+\  then  for  almost  every 


(u,v)  e  Rn  x  Rra,  (p(u,v))  is  a  Morse  program. 
(See  the  remark  previous  to  Theorem  E  in  section  4.) 

2) 


Truman  Bewley  suggested  the  use  of  the  Arau jo/Mas-Colell  theorem.  For  our 
application,  their  theorem  can  be  stated  "Let  X  be  a  subset  of  Rn, 

1  i — *  .  v  x  Rn_^  r!  be  defined  by  $(;.,u)  = 

Then  the  function  $(•  ,u)  :  X  -►  R1  has  at 
XI - 


be  continuous,  and  $ 


^(x)  -  u  x  for  x  e  X,  u  e  R 
most  one  minimizer  for  almost  every  u  £  R1 


C,  let  X  = 


g5^  ( fcrt-v) 


For  our  application  for  Theorem 


and  $(x,u)  =  f(x)  -  u 


-1  1- 


Equality  Constraints:  Global  Properties  of  Proper  Morse  Programs 


A  mapping  g  :  Rn  >  Rm  is  called  proper  if  the  preimage  of  every  compact 
set  in  Rm  is  compact  in  Rn.  It  is  easily  shown  that  g  is  proper  if  and 
only  if 

{X  }  c  Rn,  IX  «  ■*■»=>  «g(Xk)«  ♦  « 

where  II  •  II  is  the  Euclidean  norm. 

Definition .  (Brown,  Heal  and  Westhoff  [3]) 

A  program  (P)  is  called  proper  if  g  is  proper. 

In  this  section  we  consider  some  global  properties  of  proper  Morse 
programs  -  global  duality  (Theorem  D)  and  local  uniqueness  (Proposition  6, 
Theorem  E) . 

A  proper  program  has  at  least  one  global  solution  since  g-1(b)  is 
compact,  hence  by  Araujo/Mas-Colell  [1]  if  (P)  is  proper  (P(u,0))  has  a 
unique  global  solution  for  almost  every  u  e  Rn.  We  will  consider  a  family  of 
parametrized  programs 

(P(y)):  minimize  {f(x)  subject  to  g(x)  =  y}  , 

xeRn 

and  its  global  optimum  value  function 

ui(y)  ;  =  minimum{f(x)  subject  to  g(x)  =  y} 

We  also  consider  a  program 

(P  ):  minimize  {f(x)  subject  to  g(x)  =  b}  , 

N 

XGK 
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and  its  dual 


(D): 


where 


maximize  i  ( X )  , 

o 

,  m 
XeR 


<J>  < X )  =  minimum  {f(x)  +  XT(g(x)  -  b)  +  ^  llg(x)  -  bt2}  , 

0  xeK  2 

K  is  a  compact  set  of  Rn,  and  a  >  0. 

Since  K  is  compact,  there  exists  a  global  minimizer  of  (j>^(X)  for  any 
X  e  Rm  and  o  >  0 . 

Hestenes  showed 

Theorem  ([9]  Chapter  5,  Theorem  4.4) 

If  x*  is  a  unique  global  minimum  of  (PR)  such  that 

*T  *T*  *m  2*?*?* 

Df ( x  )  +  Dg( x  )  X  =0  for  some  X  Z  R  and  D  f(x  )  +  £  A  D  g.(x  )  is 

1  1  1 

positive  definite  on  Ker  Dg(x  ),  then  there  exists  oQ  >  0  such  that  for 

*  * 

any  cr  >  aQ,  x  is  a  unique  global  solution  of  ^(X  )  and  hence 

♦0(X*)  =  f(x*). 

As  a  matter  of  fact,  we  can  claim 

< X  )  =  max  <p  (X) 
a  .  a 


namely  we  have 
Theorem  D 

TP  ~  4  «  Mr-v  V  r< « 


X 


then  there  exists  >  0  such  that  for  any  a  >  ,  x*  is  a  unique  global 

solution  of  p  (A  )  and 


*  * 

P  (A  )  =  max  $  (A)  *  u(b)  =  f(x  ) 
a  ,  a 


Remark 


2  m  |  ^ 

The  assumption  is  satisfied  almost  always  if  f  e  c  and  g  c  c  , 


Proof 


Since  K  _o  g-1(b),  we  have  o)(b)  = 

* 

p  (A  )  =  max  p  (A),  which  follows  from 
o  ,  a 


* 

f(x  ),  hence  it  suffices  to  show 
(4.1)  in  the  next  lemma. 


Q » E « D« 


Lemma  4 


(a)  (JM*)  is  a  concave  function  of  A  for  any  a  >  0 

(b)  For  any  A  e  Rm,  g(x^)  “  b  is  a  super gradient1 *  of 

4)  at  A,  where  x,  is  a  global  minimizer  of  4>  (A). 

O  A  0 

Proof 

(a)  is  trivial.  ( b) :  We  will  show  that  for  any  vi  e  Rm, 


(4.1  ) 


<l>  (u)  <  4>  (A)  +  ( m-A )T( g(x. )  -  b)  . 
0  0  A 


By  the  definition  of  x^ ,  we  have 

(4.2)  p  (u)  =  f(x  )  +  yT(g(x  ) 

0  M  U 

(4.3)  Pa(\)  =  f(xx)  +  AT(g(xx) 


b)  +  |  »g(xu)  -  b«2  , 
b)  +  ^  Ig(x^)  -  bl2  , 


1) 

Rockefeller  ((13]  §23) 
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and 


(4.4) 


$0<U)  <  f(xx)  +  MT(g(xx)  -  b)  +  ~  Hg(xx)  -  bll2  . 


Substituting  (4.2)  and  (4.3)  into  (4.4),  we  obtain  (4.1). 


Let  us  define  a  function  F  :  R°  x  Rm  *  Rm  *  Rn  x  Rm  by 


Q.E.D. 


F(x,X,y)  :  =  (Df(x)T  +  Dg(x)TX,  g(x)  -  y) 


We  define  F  (x,X)  as  F(x,X,y).  The  next  lemma  is  a  key  step  toward  our 
sensitivity  analysis  of  proper  Morse  programs. 

Lemma  5  (cf.  Brown/Heal/Westhof f  [3]) 

If  g  is  proper,  then 

(a)  (P(y))  is  a  Morse  program 


*=*  ye  Y  :  =  {ye  Rm  |  g.i,  y,  if  3} 

(b)  Y  is  open  in  R01 
Proof  (a)  is  equivalent  to  Theorem  5. 

(b):  We  claim  that  { y  I  g  f  y}  is  open  in  r"1  and  {ylg  f  y,  A  0}  is 
open  in  {ylg  *  y) .  Since  both  proofs  are  similar,  we  omit  the  first  proof. 
So  we  will  prove  {ylg  f  y,  F  f  is  in  (ylg  if  y}  which  is  open  in 

Rm . 

Suppose  it  is  not  open  at  y°  e  {y  |  g  f  y ,  if  0} .  Then  there  exist 
yn  e  {y|g  f  y}  ,  ( xn ,  Xn )  e  F  ^O)  such  that  yn  ♦  y^  and  DF  _(xn,  Xn)  is 

yn  y 


singular.  Let  K  be  a  compact  neighborhood  of  y®  such  that  K  _  {ylg  i  y) 

and  hence  Dg(x)  has  full  rank  for  any  x  £  g  \k). 

Now  for  sufficiently  large  n,  x11  e  g  ^  (K)  •  Since  g  is  proper  and 

n  . 

g  '(K)  is  compact,  there  exists  a  subsequence  {x  "* }  of  { x°}  such  that 
n  .  ^  n  .  q  q  ^  n  n 

x  ^  e  g  (K),  x  ^  +  x  for  some  x  e  g  (K)  .  Since  (x  3,  y  3)  ■»  ( x° ,  y° ) 

and  g(x  =  y  i,  we  have  g(x®)  =  y® .  By  g  A  yn  we  have 


,,  c>  ,n  n,  /■_  ,  n._  ,  n,Ti-1„  ,  n.„,,  n.T 

(4.5)  A  =  A(x  )  :  =  -[Dg(x  )Dg(x  )  J  Dg(x  )Df(x  ) 

-1  nT 

Since  A(*)  is  a  continuous  function  of  x  on  g  (K),  and  since  x  J , 

0  n  o  n  .  o  q 

x  e  K  and  x  3  +  x  ,  we  have  A"1-*-!  :  =  A(x  ).  Then  we  obtain 


n.n.n  nnn  n.n. 

(x  ■’.A  ^ ,  y  -1)  ♦  (x  ,A  ,y  )  and  0=F  (x3,A3)-*’F_(x,A)=0 

n  o 

y  y 


By  F  Q  A  0,  DF  Q( x°,  A° )  is  nonsingular.  However  we  have  also 

y  y 

n.n.  00  n.n. 

DF  (x  "'.A  ^ )  -*■  DF  (x  ,A  ),  hence  DF  (x  ^,A  ^  )  is  nonsingular  for 
n .  0  n . 

y  i  y  y  : 

sufficiently  large  n^,  which  contradicts  our  assumption.  Therefore 
{ylg  A  y,  Fy  A  0}  is  open  in  {ylg  4,  y}. 

Q .  E  .  D , 

Proposition  6  (Local  Uniqueness) 

Let  g  be  a  proper  function.  Then  the  number  of  critical  points  of 
(P(y) ) ,  denoted  #(P(y)),  is  finite  for  any  y  e  Y,  and  it  is  a  locally 
constant  function  on  the  open  set  Y . 
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Proof 


Let  (P(y))  be  a  proper  Morse  program,  then  g  \y)  is  compact  and  each 
critical  point  of  (P(y))  is  isolated.  An  isolated  set  in  a  compact  set  is 
finite,  hence  #(P(y))  is  finite.  Let  #(P(y))  =  k  and  let  x1  and  X1  be 
respectively  a  critical  point  of  (P(y))  and  its  associated  Lagrange 
multiplier  (i  =  1,2, By  the  implicit  function  theorem  (Edwards  [5]  p. 
417),  for  each  i  =  1,***,k;  there  exist  neighborhoods  W1(y)  c  Y, 

U^Cx^)  £  Rn,  V1(Ai)  £  Rm,  and  C1  functions  x^(*)  :  W'*'  ♦  U1, 

X1 ( • )  :  W1  V1  such  that 

(xNy)  ,Xi(y)  )  =  (xi,Xi) 

(4.6)  F(x,A,y)  =  0  <=>  (x,X)  =  ( xi(  y)  ,Xi(  y )  )  on  *  V1  x  W1 

k 

Now  let  us  take  a  neighborhood  W  of  y  such  that  w  £  n  W1  and 
Ik 

x  ( W) , • • • ,x  (W)  are  pairwise  disjoint. 

Since  F( x^ ( y) , A* ( y) ,y )  =  0  for  y  e  W,  x^(y)  is  a  critical  point  of 

1  k 

(P(y))  for  i  =  1,#**,k.  Since  x  (W),***,x  (W)  are  pairwise  disjoint, 

1  k 

x  (y),***,x  (y)  are  k  distinct  critical  points  of  (P(y)).  Therefore  we 
obtain  #(P(y))  >  k  for  yew. 

Let  us  show  that  actually  equality  holds.  Suppose,  to  the  contrary, 

l  i  i  —  l 

there  exists  {y  }  such  that  y  e  W,  y  ♦  y  and  #(P(y  ))  >  k.  Then  there 

exists  {(x*,A*)}  such  that  F(x^,X^,y*)  =  0  and  x^  ^  { x 1 ( y^ ),•••, xN )} . 
i  l 

Note  that  x  is  a  critical  point  of  (P(y  ))  with  the  associated  Lagrange 
multiplier  X  . 
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Take  e  >  0  so  that  a  closed  e-ball  B£(y)  £  w,  then  there  exists  L 

£  —  -1  — 
such  that  i  >  L  =»  y  e  B£(y}.  Since  g  is  proper,  g  (B  (y))  is  compact 

i  - 1  — 

and  £  >  L  =»  x  eg  (B(y)).  Then  there  exists  a  converging  subsequence  of 

£  £  £  * 
lx  }  For  the  notational  convenience  we  assume  x  ♦  x  for  some 

X  ^  Li  • 

*  -1  —  - 

x  e  g  (Be(y)).  Since  B£(y)  Dg(x)  is  of  full  rank  for  any 

x  e  g  1  ( B£  ( y ) )  .  Therefore,  1  <3  1(B£(y))»  x  e  g  Vb  (y)),  x*  -►  x 

£  *  *  JR 

imply  X  ♦  X  for  some  X  e  R  by  (4.5).  Then  by  the  continuity  of  F, 
we  obtain  F(x  ,X  ,y)  =0.  This  implies  (x  ,X  )  ■  (x  ,XJ)  for  some 
j  e  {l,*»*,k},  hence  for  sufficiently  large  l,  we  obtain 

lit  iii  j  j  j 

F( x  ,X  ,y  )  *  0  ,  (x  ,X  ,y  )  e  UJ  x  \r  x  wJ 


and 


i  I  r  1,  i,  k,  i,. 

x  4  lx  (y  ),«••, x  (y  )} 

This  contradicts  to  (4.6),  so  completes  the  proof. 

^  Q.E.D. 

Note  that  w(y)  =  min  f(x*(y))  for  y  z  W,  and  hence  we  obtain 
1<i<k 

Corollary  7 

If  ( P ( y ) )  is  a  proper  Morse  program,  then  in  a  neighborhood  of  y, 
oj ( • )  is  the  minimum  of  a  finite  number  (=  #(P(y))  of_  C  functions  (as  a 
result  u(*)  is  a  locally  Lipschitz  function  on  the  open  set  Y).  Moreover, 

xf  <  P ( y )  )  has  a  unique  global  solution,  then  in  a  neighborhood  of  y, 

2 

u)  ( • )  Isa  C  function. 
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Proof 


It  is  easily  verified  (e.g.  Luenberger  [11],  10.5)  that 

Df(xi(y))  =  -Xi(y),  D2f(xi(y))  =  -DXi(y)  (i  =  1,»*»,k)  , 

hence  f(x1(»))  is  in  C2.  The  fact  that  to ( • )  is  locally  Lipschitz  on  Y 
follows  from  Clarke  [4] . 

Q. E. D. 

Remark 

The  differentiability  of  the  local  optimum  value  function  was  shown  by 
Fiacco/McCormick  [6]  and  Fiacco  [7] ,  using  the  implicit  function  theorem.  In 
our  proper  programs,  we  consider  the  global  optimum  value  function  w(*),  and 
we  will  show  in  Theorem  E(d),  that  the  global  optimum  value  function 

T 

a>(u,v)  :  =  minimum{f(x)  -  u  x  subject  to  g(x)  =  b  +  v) 


for  (P(u,v))  is  C  function  of  (u,v)  on  an  open  and  dense  set  of 

n  m  2  .  n-nH-1 

R  x  R  ,  if  fee  and  gee  . 


Now  let  us  make  a  few  remarks  on  the  open  set  Y. 


Definition  ( Brown/Heal/Westhof f [3] ) 

A  program  (P)  is  called  regular  if  F  A  0. 

The  regularity  is  a  generic  property,  namely  if  f  and  g  e  cm+2  (hence 
F  e  c"*1),  then  F  A  (u,v)  for  almost  every  (u,v)  e  Rn  x  Rm  by  Sard's 
theorem,  hence  (P(u,v) )  is  regular  for  almost  every  (u,v)  e  Rn  x  Rm.  if 
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f,g  e  Cm+2  and  F  A  0,  then  Ji  0  for  almost  every  y  e  Rm  by  virtue  of 
the  parametric  transversality  theorem  (Appendix  (4)).  Since  g  e  Cn  m+1/ 
this  implies  g  k  y  for  almost  every  y  e  Rm,  summarizing  the  above  we 
obtain 

Proposition  8  (Brown/Heal/Westhoff  [3] ) 

(a)  If.  f,g  e  c"*2  then  (P(u,v))  is  a  regular  program  for  almost 
every  (u,v)  e  Rnx  Rm. 

(b)  J_f  (P)  is  regular,  fee  ,  g  e  C  then  y  has 

full  measure  in  R™. 

Corollary  9  (cf.  [3] ) 

If  (P)  js  a  proper  regular  program,  f  e  Cm+2,  and 
gee  ,  then  Y  is  open  and  dense  m  k  . 

Our  final  result  in  this  section  considers  the  differentiability  of  the 
global  optimum  value  function  <*)(•,•)  for  (P(u,v)). 

First  let  us  define  F  :  R°  *  R1"  x  Rn  x  Rm  +  Rn  x  Rm  by 


—  T  T 

F(x,A,u,v)  :  =  (Df(x)  -  u  +  Dg(x)  A,  g(x)  -  b  -  v) 


and  F  :  R11  x  Rm  +  Rn  x  Rm  by 

(u,v) 


F,  , ( x, A }  :  =  F(x,A,u,v) 
( u,  v) 


Then  we  have 


DF,  . ( x, A )  = 
(u,v) 


L(x)  Dg(x)' 


Dg(  x) 


2  r  2 

where  L(x)  =  D  f(x)  +  I  A^D  g^(x).  Therefore  following  exactly  the  same 
argument  as  in  Theorem  B,  we  obtain 


Lemma  10 


T  —  1 

If  g  A  b  +  v,  then  f(x)  -  u  x  is  a  Morse  function  on  g  (fcrt-v)  if 
and  only  if  F,  ,  0 . 

Let  us  denote 

Z  :  =  {(u,v)  e  Rn  x  Rm|(P(u,v))  is  a  Morse  program} 

and 

(P(u,v))  is  a  Morse  program 
having  a  unique  global  solution 

Then  by  Lemma  10  we  have 

Z  =  {(u,v)  e  Rn  x  Rra|g  fa  b  +  v,  F  AO} 

1U/V) 

Note  that  if  fee2  and  g  e  Cn  ,  then  Z  has  full  measure  in 

R°  x  Rm.  Because  {(u,v)|g  A  b  +  v}  has  full  measure  and 

{ ( u,v) | F  .  A  0}  has  full  measure  by  Sard's  theorem. 

(u,v)  J 

Following  essentially  the  same  argument  as  in  Lemma  5  and  Proposition  6, 
it  is  easy  to  prove  the  following 
Theorem  E 

Suppose  g  is  a  proper  function.  Then  we  have 

(a)  Z  and  Z!  are  open  sets  of  Rn  x  Rm 

(b)  the  number  of  critical  points  of  (P(u,v))  is  finite  for  any 

(u,v)  e  Z,  and  it  is  locally  constant  on  Z. 

(c)  a )(•»•)  is  locally  expressive  as  the  minimum  of  a  finite  number 

2 

of  C  functions  on  Z. 

(d)  _If  fee2  and  g  e  cn  m+1  ,  then  u(*,*)  is  a  C2  function 


.  .  n  m 

(u,v)  e  R  x  r 


5.  Inequality  Constraints:  Definition  of  Morse  Programs 
Let  us  consider  a  program 

(Q)t  minimize{ f ( x)  subject  to  g(x)  <  b} 

and  a  perturbation 

T 

(Q(U/V)):  minimize! f( x)  -  u  x  subject  to  g(x)  <  b  +  v} 

where  f  :  Rn  *  R^  and  g  :  Rn  *  Rm  are  of  class  C^,  u  e  Rn,  v  e  Rm  and 
n  >  m. 

Let  I  :  *  g  (x):  =  (g.(x))  ,  b:  *  (b  .)  ,  Jc:  =  I  -  J 

J  3  jej  J  3  gej 

for  all  J  c_  I.  Let  us  denote 

M,  i:  =  { x|g  (x)  =  b  ,  g .  ( x)  <  b.} 

U  t  X  J  J  1  1 

3m  :  =  ( x |g  ( x)  =  b  ,  g  (x)  =  b  } 

u  t  1  J  J  X  1 

for  all  J  c  I  and  i  e  I.  For  the  notational  convenience,  we  denote  M^:  = 
M,  4  if  i  e  J  and  X,:=  M,  3x.s  =  3M,  .  if  J  «  6. 

u,i  i  J , i  i  j ,  i 

Note  that  if  i  e  J  then  M_  .  =  3M„  .  *  M_. 

J,i  J,i  J 

We  will  reduce  the  inequality  case  to  some  equalities  and  one  inequality 


Definition.  A  program  (Q)  is  called  a  Morse  program  if  (Q)  satisfies 
(Ml)  g^  A  b^  for  all  i  £  I 

(M2)  gjj  ^  bj  and  A  for  all  nonempty  J  c  i  and 

i  4  J 

(M3)  f  is  a  Morse  function  on  M,  4  and  3m  for  all  J  c  1 

J'1  J,i  — 

and  i  e  I 

( M4 )  f|„  has  no  critical  points  on  3m,  .  for  all  J  c  i  and 

MJ,i  J,i  — 

i  4  J . 
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Remark 


By  (Ml),  X.  =  {x|g.(x)  <  bj  is  n-dimensional  manifold  with  boundary 

3x  =  g  .  ^  (  b  )  (Appendix  (10)).  Then  (M2)  implies  that  Mj  i  =  Mj  1  xi  1S 

(n  -  I J I )-dimensional  manifold  with  boundary  3m  =  M,  n  3x.  =  M„  ,  . , 

'  J ,  1  J  1  JO  { 1 } 

(Appendix  (11)).  These  manifolds  of  different  dimensions  cover  the  feasible 
region  of  (Q),  and  by  (M3)  we  will  restrict  the  objective  function  f  on  each 
manifold  when  we  argue  the  optimality  conditions  of  (2)-  In  the  next  section 
(Proposition  15),  we  will  show  that  assuming  (Ml)  and  (M2),  (M4)  implies  the 

strict  complementary  slackness  condition. 

Definition .  x  is  a  critical  point  of  (Q)  if  g(x)  <  fc  ar.d  x  is  a  critical 
point  of  Mj(x)  where  J(x):  =  { i | g  (x)  =  b^}. 

The  next  theorem  states  the  important  properties  of  a  Morse  program, 
which  is  analogous  to  Theorem  A. 

Theorem  F.  If  (Q)  is  a  Morse  program  and  x  is  a  critical  point  of  (Q)  with 
J  =  J( x) ,  then 

(a)  Dgj(x)  has  full  rank. 

T 

^  bj 1 )  there  exists  a  unique  x  E  Rm  such  that  D f  (  x ) 

+  Dg(x)TX  =  0  and  f  0  iff  i  £  J. 

m 

?  r  2 

(c)  L(x)  =  D  f(x)  +  l  X.D  g.(x)  induces  an  isomorphism  on 

i=1  1  1 

TxMJ* 

(d)  Oil  TxMj/  L(x)  is  positive  definite  iff  x  is  a  local 
minimum;  negative  definite  iff  x  is  a  local  maximum; 
indefinite  iff  x  is  a  saddle  point  on  M j . 


1  ) 

•  .  >  0  for  all  I'd  If  x  is  a  local  minimum,  X  ^  <  0  for  all  j  J 
if  "'x  is  a  local  maximum  (see  Luenberger  [11],  10.6). 
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Proof .  (a)  and  (c)  follow  from  (Ml),  (M2)  and  Lemma  3.  ( b)  follows  from 
Lemma  1  and  (M4)  (see  Proposition  15).  Since  a  local  minimum  (or  maximum) 
point  of  (Q)  is  also  a  local  minimum  (or  maximum)  point  of  f  on  MJ(  (d) 
follows  from  Theorem  A(d). 


6.  Inequality  Constraints:  Generic  Properties  of  Morse  Programs 

We  will  show  that  if  f  £  and  g  e  cn,  then  for  almost  every  fixed 

v  £  Rm,  (Q(u,v))  is  a  Morse  program  for  almost  every  u  £  Rn.  First  of  al) 
we  consider  the  genericity  of  properties  (Ml)  -  (M3). 

Lemma  1 1 .  If  g  £  c",  then  (Ml)  and  (M2)  hold  for  almost  every  be  Rm. 

Proof.  We  follow  the  proof  of  Spingarn/Rockafellar  [17],  Theorem  1.  By 

Sard's  theorem,  if  g  e  C°  then  the  set  of  critical  values  of  g^  is  of 

measure  zero  in  R^  for  i  =  1,...,m.  Then  T  ^  :  =  { b  £  Rm  |  b  ^  is  a 

critical  value  of  g  }  is  of  measure  zero  in  Rm  ( i  =  1,...,m),  because 

every  ( m- | i | ) -dimensional  horizontal  slice  of  T^  is  of  measure  zero  as  a 

subset  of  R^',  hence  Ti  itself  must  have  measure  zero  by  Fubini's  theorem 

m 


(Appendix  (3)).  Hence  T  =  U  t.  has  measure  zero.  By  Sard's  theorem  with 

i=1  1 

boundary  (Appendix  (2)),  if  g  £  C  and  b  £  R  -  T  (hence  is  n- 


dimensional  manifold  with  boundary  3x.),  then  for  any  nonempty  J  -  I  and 


any 


i  f  J,  the  set  of  critical  values  of 


or  g 


is  of  measure 


'ax. 


zero  in  R1  1 .  So,  again,  by  Fubini's  theorem  (Appendix  (3)), 


J,i 


,  b,  is  a  critical  value  of  | 

.  m  I  J 

b  £  R  -  T  > 

°r  9j'ax.  I 

X  1 


has  measure  zero  in  Rm  for  all  nonempty  J  c  I  and  all  i  j;  J.  Then 


S  :  =  u  S,  •  has  measure  zero  in  R  . 
J ,  i 


Q.E.D. 
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Let  us  take  b£S={beR  |  b  satisfies  (Ml)  and  (M2)}.  Then  for  any 
J  c  i  and  i  e  I,  f(x)  -  uTX  is  a  Morse  function  on  M.  ,  and  3m.  for 

—  3,1 

almost  every  u  £  Rn  by  Appendix  (6).  Therefore  we  obtain 
Corollary  12.  If  f  £  and  g  £  cn,  then  for  almost  every  v  £  Rm, 

(Q(U/V))  satisfies  (Ml),  (M2)  and  (M3)  for  almost  every  u  £  Rn. 

The  genericity  of  the  strict  complementary  slackness  condition  is  much  more 
complicated  and  we  need  some  preliminary  results. 

Proposition  13 

Let  M  be  an  m- dimensional  Cr  manifold  in  Rn  with  nonempty  boundary 
3m  and  let  f  :  M  *  R1  be  a  Cr  map.  Then  for  almost  every  u  e  Rn,  Cr 
map  f(x)  -  uTx  defined  on  M  has  no  critical  point  on  3m. 

Proof1)  x  £  M  is  a  critical  point  of  f(x)  -  uTx  iff  Df(x)T  -  u  1  T  M  iff 
-  x 

T  XX 

u  £  Df ( x)  +  T^M  (T^M  is  the  orthogonal  complement  of  T^M  in  Rn) .  Let 

Ti  T  X 

E  s  =  {(x,u)  £  3M  x  r  |u  £  Df ( x)  +  T^M  }.  Then  E  is  ( n-1 )-dimensional 
r- 1  n 

C  submanifold  of  3m  x  r  .  Let  us  prove  this  fact.  For  any  given 


x  e  3M  there  exists  an  open  set  U  of  Rn  and  a  submersion  g  :  U  R1 


n-m 


■v  —  1  —  -v 

such  that  U  :  =  M  n  U  =  g  (0)  and  x  e  3u  :  =  3M  n  U  (Appendix  (7)).  Let 
t  :  3D  x  Rn  11  +  *  r"  be  $(x,y)  :  =  (x,  Df(x)T  +  Dg(x)Ty);  (4>,V)  be  a 

local  parametrization  of  3m  at  x  such  that  x  =  <(>  ( v ) ,  v  £  R1”-1,  and 

4>(v)  £  3U;  and  :  V  x  Rn  m  •*  3m  x  Rn  be  i>(v,y)  =  $(<t>(v),  y).  Then 
<|i  £  Cr  1  and  for  any  (v,y)  £  V  x  Rn  m  we  have 


D<H  v,  y)  = 


D<j>  (v) 


Dg(  ip  (  /)  )' 


1) 

This  line  of  argument  was  suggested  by  W.  G.  Dwyer. 
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T 

Since  D<j>(v)  and  Dg( <J> ( v)  )  is  1-1,  D^»(v,y)  is  1-1  (i.e.  ip  is  an 

immersion)  hence  by  the  definition  4  is  an  immersion.  Let  E(3U)  = 

{(x,u)  e  3U  x  Rn|u  £  Df(x)T  +  T  c  3m  x  Rn ,  then  since  T  =  Im  Dg(x)T 

x  —  x 

*  :  3u  x  r°  m  ■*  e(3U)  is  bijective  and  proper,  hence  4  is  an  embedding  of 
3U  x  Rn  m  into  3m  x  r°.  Consequently  E(3U)  is  a  cr  1  manifold 
(Appendix  (8))  parametrized  by  $,  with  dimension  *»  dim  3u+n-m=m-1  + 
n  -  m  =  n  -  1 .  Since  every  point  of  E  has  such  a  neighborhood,  E  is  a 

Is—  1 

C  manifold,  (cf.  Guillemin/Pollack  [8],  normal  bundle  on  page  71.)  Let 

j  :  3m  x  Rn  +  sn  be  a  projection  map.  Then  since  E  is  (n-1 )-dimensional, 

it (E )  Rn  has  measure  zero  in  Rn  (Appendix  (9)). 

n  t  1 

Since  it(E)  =  {ue  R  |ue  Df(x)  +  T^M  for  some  x  e  3m}  has  measure 
zero,  for  almost  every  u  e  Rn  (i.e.,  u  ej  tt(E))  every  x  £  3M  is  not  a 
critical  point  of  f(x)  -  uTx  on  M.  This  completes  the  proof. 


Q«E*D* 


Lemma  14.  Let  g  s  Rn  Rm,  h  :  R°  ♦  R1;  be  R™,  cCR1;  n  >  m  +  1; 

X  s  =  {x|h(x)  *  c} ,  and  3x  =  h  ^(c).  Suppose  h  A  c,  then  we  have 

-1 


(a) 


If  gjx  ^  b,  9|gx  ^  b  then  M  s  =  g  (b)  n  X  Jj3  (n-m)- 


and  T  3M 

-  X 

=  Ker  Dg(x)  n  Ker  Dh(x). 

(b) 

g|3x  *  b 

iff  (g,h)  *  ( b,c) . 

Proof 

.  Since 

h  A  c,  X 

is  n-dimensional  manifold  with  boundary 

3X  = 

h_1(c) 

by  Appendix 

(10). 

(a) : 

By  Appendix  (11),  M  is  ( n-m) -dimensional  manifold  with 

boundary 

3M  -  ^b)  n  h  '(c).  g,*.„  iK  b  and  T  3x  = 

J  dX  X 

Ker  Dh(X) 

imply  T^SM  =  Ker  Dg(x)  n  Ker  Dh(x)  by  Appendix 

(12)  . 
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(b); 


(only  if):  Since  dim  T  3M  =  n-m-1,  (D^X?)  :  R°  *  Rm  x  r1 

x  vDh(x)' 

is  onto  for  any  x  e  3m,  hence  (g,h)  A  (b,c). 

(if):  Let  x  e  <  ^  j  gx  i  Vb)  i»e.  *  e  (g*h)  ^b.c).  We  will 

show  that  Dg(x).  :  T  3X  +  Rm  is  onto.  Since  T  3X  = 

T  3X  x  x 

x 

Ker  Dh(x),  Ker(Dg(x).  )  =  Ker  Dg(x)  n  Ker  Dh(x).  However 

x 

dim(Ker  Dg(x)  n  Ker  Dh(x))  =  n-m-1  because  (g,h)  A  (b,c), 

and  since  dim  T  3 X  =  n-1,  we  obtain  Dg(x),  .  is  onto, 
x  T  3x 

x 

Hence  9 | gx  A  b. 

Q.E.D. 


Theorem  G.  (Strict  Complementary  Slackness) 


Consider  a  nonlinear  programming  problem 


minimize  {f(x)  subject  to  g(x)  =  b,  h(x)  <  c} 
where  f  :  Rn  +  R1,  g  :  Rn  -*■  Rm,  h  :  R°  R1;  f,g,h  EC1;  n  >  m+1. 

Let  X  :  =  {x|h(x)  4  c} ,  3X  :  =  h  ^c),  M  :  =  g_1(b)  n  X,  and 

3M  :  =  g  ^b)  n  3X.  Suppose  h  A  c,  gjx  A  b  and  9|gx  *  b.  Let  x*  be  a 

♦ 

critical  point  of  Then  the  Lagrange  multiplier  y  associated  with 

* 

the  constraint  h(x)  4  c  is  nonzero  if  and  only  if  x  is  not  a  critical 
point  of  f |M« 

Proof .  By  Lemma  14(a),  M  is  ( n-m)-dimensional  manifold  with  boundary  3M. 

*  *  1 

Note  that  x  is  a  critical  point  of  f j gM  and  only  if  Df(x  )  e  T  ^3m  . 

1  *  T  *  T  X 

We  have  T  ^3M  =  Im(Dg(x  )  ,  Dh(x  )  )  because  (g,h)  A  (b,c)  by  Lemma 

x  *  *  m  1 

14(b),  hence  there  exists  a  unique  (X  ,y  )  e  R  x  r  such  that 


(6.1 ) 


*  T*  *  *  T  * 

Df(x  )  +  Dg(x  )  A  +  Dh(x  )  p  =  0  . 
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*  *  T  i  1  *  >■ 

If  x  is  not  a  critical  point  of  f | M ,  then  Df(x  )  f  T  #M  =  Im  Dg(x  ) 

.  x 

*  * 

and  hence  in  (6.1),  m  f  0.  On  the  other  hand  if  x  is  a  critical  point 

*  *  * 

f|M,  then  by  the  uniqueness  of  (A  )  in  (6.1),  p  =0. 


Q.E.D. 

This  theorem  provides  a  geometric  interpretation  of  the  strict 
complementary  slackness,  namely  the  degenerate  Lagrange  multiplier  occurs  if 
and  only  if  the  critical  point  of  f  on  the  boundary  of  the  manifold  M  is 
also  a  critcal  point  of  f|M.  bet  us  illustrate  this  fact  by  an  example. 
Example  (Avriel  [2],  Example  3.1.4) 


Consider  the  following  programs 


minimize  f(x)  =  x^ 

subject  to  g(x)  =  (Xj-3)2  +  (x2~2)2  -  13  =  0 


It  is  easily  verified  that  g  ik  0,  h  i  0.  g(  ,  A  0  is  obvious  because 

' h" 1 ( 0  ) 

{x|g(x)  =  0}  meets  (x|h(x)  =  0}  transversally .  Hence  all  assumptions  in 
Theorem  G  are  satisfied. 

—1  —2 

Let  M  :  =  {x|g(x)  =  0,  h(x)  <  0},  then  3m  :  =  {x  ,  x  }.  Since  every 

point  is  a  critical  point  of  any  function  defined  on  0-dimensional  manifold, 
—1  —2 

x  and  x  are  critical  points  of  ^|gM*  Since  Df(x)  =  (1,0)  for  any 


x  e  Rn,  f|M  has  only  one  critical  point  x-  which  is  not  an  element  of 

9M.  Therefore  by  Theorem  G,  the  associated  Lagrange  multiplier  of  the 

—1  —2  —1  —2 

constraint  h(x)  <  0,  p  (or  p  )  at  x  (or  x  )  is  nonzero. 

Now  we  can  show  that  (M4)  implies  the  strict  complementary  slackness 
condition. 

Proposition  IS 

Suppose  (Q)  satisfies  (Ml),  (M2)  and  (M4).  Then  every  Lagrange 
multiplier  associated  with  an  active  constraint  is  nonzero  (i.e.  strict 
complementary  slackness  condition  holds) . 

Proof 

Let  x  be  a  critical  point  of  (Q)  such  that  J  =  J(x).  Then  by  (Ml)  and 
(M2),  there  exists  a  unique  X  e  Rm  such  that  X  =  0  and 

iJ 


-3 


Df (x)T  +  £  X .Dg. (x)  =  0 

jEJ  3  3 


To  show  X_.  +  0  for  all  jEJ,  pick  any  j  e  J.  By  (Ml)  and  (M2),  we  have 


gj  *  V 


A  b 


IX. 


'j-dr  ’j-(j) 


A  b 


9x  . 

D 
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Since  x  is  a  critical  point  of  (Q),  this  means  x  is  a  critcal  point  of 


and  M_  =  3M 


i  —  on  ,  .  i 


.  By  (M4),  x  is  not  a  critical  point  of 


Hence  by  Theorem  G,  the  Lagrange  multiplier  A  .  associated  with 


the  constraint  g.(x)  <  b.  is  nonzero. 
D  J 


Q .  E.  D. 


By  Proposition  13,  the  genericity  of  (M4)  is  obtained  and  hence  we  have 
Theorem  H  (cf.  Spingarn/Rockaf ellar  [17],  Corollary) 

If  f  e  and  g  e  cn,  then  for  almost  every  fixed  v  e  Rm,  (Q(u,v)) 

is  a  Morse  program  having  at  most  one  global  solution  for  almost  every 


n 

u  e  R  . 


Proof 


By  Araujo/Mascolell  ([1]),  we  have  also 

Fix  any  v  e  Rm,  then  for  almost  every  u  e  Rn  (Q(u,v))  has  at  most 


one  global  solution. 


Use  Corollary  12,  and  Proposition  13. 


Q .  E .  D. 
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Appendix 


(Guillemin/Pollack  [8],  Hirsch  (10]  > 

( 1 )  Morse  lemma 

Let  p  e  M  be  a  nondegenerate  critical  point  of  f  :  M  ■*  R1.  Then  there 
is  a  local  coordinate  system  )  in  a  neighborhood  U  of  p  such 

that 


f  =  f  (p)  -  x  -  . . 


2  2  2 

X  X+1  m 


for  some  0  <  X  <  m. 

(2)  Sard's  theorem  (with  boundary) 

v  Y 

Let  f  :  X  -*■  Y  be  a  C  map  of  a  C  manifold  X  with  boundary  3X 
v 

into  a  boundaryless  C  manifold  Y.  Then  almost  every  y  e  Y  is  a  regular 
value  of  both  f  s  X  ♦  Y  and  f|gx  :  8x  Y  if  y  >  max(0,  dim  X  - 
dim  Y ) . 

( 3 )  Fubini's  theorem 

Let  A  Rn  x  Rm  be  a  measurable  set  such  that  for  almost  every 

v  e  Rm,  #-v  =  {u  £  Rn|(u,v)  e  a}  has  measure  zero  in  Rn.  Then  A  has 
n  m 

measure  zero  in  R  x  R  . 


( 4 )  Parametric  transversality  theorem 


Let  F  :  X  x  v 

+  Y 

be  a 

CY 

map 

of  CY 

manifolds  and  A 

y 

be  any  c 

submanifold  of  Y. 

If 

F*  A 

and 

Y  > 

max(0. 

dim  X 

-  dim 

Y) 

then  Fy  M  A 

for  almost  every  v 

e  v 

where 

Fv 

(X)  = 

F(x,v) 

for 

x  e  x 

• 

(5)  Let  f  :  X  Y 

be 

a 

map 

such 

that  f 

*  z 

for  a 

CY 

submanifold 

Z  of  Y,  then  f-1 

(Z) 

is  a 

CY 

submanifold 

of  X 

and 

dim 

f_1(Z)  = 

dim  X  -  dim  Y 

+■  dim  Z.  As  a  special 

case 

if 

f  *  y  for  some  y  i 

Y,  then 

t” 1 ( y )  is  a 

C^1  submanifold  of  X 

and 

dim 

f~ 1 ( y )  =  dim  X  -  dim 

Y  . 

(to)  Let  f  : 

X  ♦  be  a  map  of 

a 

e2 

manifold  X  in  Rn. 

Then  for 

almost  every  u  e  Rn  the  function  f(x)  -  uTx  is  a  Morse  function  on  X. 

(7)  Let  X  _  Kn  be  m-dimensional  manifold  with  boundary  3X.  Then  for  each 

point  x  e  3X,  there  exists  an  open  set  U  of  Rn  and  a  submersion 

"t  n-  m  ~  - 1  ,.~ 

g  :  U  ♦  R  such  that  U  =  X  U  =  g  (0)  and  x  e  JU  =  oX  U. 

(8)  An  embedding  f  :  X  ♦  Y  maps  X  dif f eromorphical ly  onto  a  submanifold 


of  Y. 

(9)  Let  X,  Y  be  manifolds  with  dim  X  <  dim  Y.  If  f  :  X  ♦  Y  is  a  C 
map  then  f(X)  has  measure  zero  in  Y. 

(10)  Let  f 


.  1 


1  Y  1 

X  *  R  be  a  C  map  such  that  f  ?  c  for  some  c  £  R  .  Then 


l x [ f ( x )  <  c}  is  a  cy  submanifold  of  X  with  boundary  f-1(c). 

Y  Y 

(11)  Let  f  :  X  *  Y  be  a  C  map  of  a  C  manifold  X  with  boundary  -x 

V 

onto  a  boundaryless  C  manifold  Y.  If  f  -  Z,  f | .  •  Z  for  a  boundaryless 

- 1  Y 

submanifold  Z  of  Y,  then  f  (Z)  is  a  C  submanifold  of  X  witn 
boundary  3f  (Z)  =  f  (Z)  3X  and  dim  f_1(Z)  =  dim  X  -  dim  Y  +  dim  Z. 

(12)  Let  X,  Z  be  submanifolds  of  Y  such  that  X  •  Z.  Then  X  Z  is 
again  a  submanifold  of  Y,  dim(X  n  Z)  =  dim  X  +  dim  Z  -  dim  Y  and  Tx(X  Z> 

=  TxX  '  TXZ  for  any  x  £  X  Z. 

More  generally,  let  f  :  X  +  Y  be  a  map  transversal  to  a  *'ubman l fold 
Z  in  Y.  Then  W  =  f-1(Z)  is  a  submanifold  of  X  and  TxW  =  Ker  Tf x  where 


Db 


V  *  Tf,x)Y- 
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